Classical Item and
Test Analysis Report
User Test 1
Report created on 18.10.2018
This report was produced by the demo version of Iteman 4.3,
which is limited to 50 items and 50 examinees.
Iteman: Software for Classical Analysis
Copyright © 2013 - Assessment Systems Corporation
Introduction
This report provides the results of a classical item and test analysis by the computer program Iteman
Version 4.3 (Assessment Systems Corporation, 2013) for User Test 1. The output is divided into three
sections:
1. Specifications
2. Summary statistics
3. Item-by-item results.
The statistical output is also recorded in a comma-separated value (CSV) file of the same name.
Specifications
The Windows paths for the input files used in this analysis were:
C:\Users\User\Desktop\ktil_5\01_date\date_7.txt
C:\Users\User\Desktop\ktil_5\01_date\control_f.txt
The Windows paths for the output files produced by this analysis were:
C:\Users\User\Desktop\ktil_5\02_results\ktil_5.rtf
C:\Users\User\Desktop\ktil_5\02_results\ktil_5.csv
C:\Users\User\Desktop\ktil_5\02_results\ktil_5 Scores.csv
Table 1 presents the specifications and basic information concerning the analysis. This provides
important documentation of the setup of the program for historical purposes.
Table 1: Specifications
Specification
Value
Specification
Value
Number of examinees
59
Total Items
25
Scored Items
25
Pretest Items
0
Multiple Choice Items
20
Polytomous Items
5
Number of domains
1
External scores
No
Minimum P
0,00
Maximum P
1,00
Minimum item mean
0,00
Maximum item mean
15,00
Minimum item
correlation
0,00
Maximum item
correlation
1,00
ITEMAN 3.0 Header
No
Exclude omits from
option statistics
No
Number of ID columns
0
ID begins in column
0
Responses begin in
column
1
Omit character
O
Not Admin character
N
Produce quantile tables
Yes
Correct for
spuriousness
Yes
Produce quantile plots
Yes
Save data matrix
No
Include omit codes in
matrix
N/A
Include Not Admin
codes in matrix
N/A
Include scaled scores
for
Total
Score
Scaling function
N/A
Scaled score setting 1
N/A
Scaled score setting 2
N/A
Dichotomous
No
Classification
Classify based on
N/A
Cutpoint
N/A
Low group label
Low
High group label
High
Data is delimited by
N/A
Test for DIF
No
Group status is in
column
N/A
Ability levels for DIF
N/A
Group 1 code
N/A
Group 2 code
N/A
Group 1 label
N/A
Group 2 label
N/A
Summary statistics
Table 2 presents the summary statistics of the test, for the scored items. Definitions of these statistics are
found in the Iteman manual.
Table 2: Summary statistics
Score
Mean
SD
Min
Score
Max
Score
Mean
P
Item
Mean
Mean
R
Scored
Items
11,92
4,22
3
22
0,48
0,44
0,28
Scaled
Total
0,00
0,00
0,00
0,00
-
-
-
Table 3 presents a reliability analysis of the tests. Alpha (also known as KR-20) is the most commonly
used index of reliability, and is therefore used to calculate the standard error of measurement (SEM) on
the raw score scale. Also presented are three configurations of split-half reliability, first as uncorrected
correlations, and then as Spearman-Brown (S-B) corrected correlations. This is because an uncorrected
split-half correlation is referenced to a "test" that only contains half as many items as the full test, and
therefore underestimates reliability.
Table 3: Reliability
Score
Alph
a
SEM
Split-
Half
(Rand
om)
Split-H
alf
(First-L
ast)
Split-H
alf
(Odd-E
ven)
S-B
Rando
m
S-B
First-L
ast
S-B
Odd-Ev
en
Scored
items
0,75
2,11
0,66
0,56
0,55
0,80
0,71
0,71
Table 4 presents the item statistics and flags for the item(s) that were flagged during the analysis
Table 4: Summary Statistics for the Flagged Items
Item ID
P / Item
Mean
R
Flag(s)
9
0,186
-0,146
K, LR
11
0,271
0,119
K
12
0,136
0,057
K
13
0,169
0,017
K
15
0,305
-0,035
K, LR
20
0,237
0,063
K
Figure 1 displays the distribution of the raw scores for the scored items across all domains.
Table 5 displays the frequency distribution for total score shown in Figure 1.
Figure 1: Total score for the scored items
Table 5: Frequency Distribution for Total Score
Score
Frequen
cy
3
1
4
1
5
3
6
3
7
1
8
2
9
4
10
7
11
9
12
2
13
5
14
3
15
5
16
3
17
5
18
2
19
2
20
0
21
0
22
1
Figure 2 displays the distribution of the P values for the dichotomously scored items (correct/incorrect).
Table 6 displays the frequency distribution of the P values shown in Figure 2.
Figure 2: P values for the scored items
Table 6: Frequency Distribution for the P values
Score
Frequen
cy
0,0 to
0,1
0
0,1 to
0,2
3
0,2 to
0,3
4
0,3 to
0,4
1
0,4 to
0,5
2
0,5 to
0,6
3
0,6 to
0,7
3
0,7 to
0,8
1
0,8 to
0,9
3
0,9 to
1,0
0
Figure 3 displays the distribution of the Item Means (rating scale or partial credit). Table 7 displays the
frequency distribution of the Item Means shown in Figure 3.
Figure 3: Item Means for the scored items
Table 7: Frequency Distribution for the Item Means
Score
Frequen
cy
0,0 to
0,1
0
0,1 to
0,2
0
0,2 to
0,3
1
0,3 to
0,4
1
0,4 to
0,5
2
0,5 to
0,6
0
0,6 to
0,7
1
0,7 to
0,8
0
0,8 to
0,9
0
0,9 to
1,0
0
Figure 4 displays the distribution of the Point-Biserial Correlations for the dichotomously scored items
(correct/incorrect). Table 8 displays the frequency distribution of the Point-Biserial correlations shown in
Figure 4.
Figure 4: Rpbis for the scored items
Table 8: Frequency Distribution for the Rpbis
Score
Frequen
cy
-0,2 to
-0,1
1
-0,1 to
0,0
1
0,0 to
0,1
4
0,1 to
0,2
2
0,2 to
0,3
1
0,3 to
0,4
6
0,4 to
0,5
4
0,5 to
0,6
1
0,6 to
0,7
0
0,7 to
0,8
0
0,8 to
0,9
0
0,9 to
0
1,0
Figure 5 displays the distribution of the Item-Total Pearson r Correlations for polytomously scored items
(rating scale or partial credit). Table 9 displays the frequency distribution of Pearsons r correlations shown
in Figure 5.
Figure 5: R for the scored items
Table 9: Frequency Distribution for Pearsons r
Score
Frequen
cy
0,0 to
0,1
0
0,1 to
0,2
0
0,2 to
0,3
1
0,3 to
0,4
1
0,4 to
0,5
2
0,5 to
0,6
0
0,6 to
0,7
1
0,7 to
0,8
0
0,8 to
0,9
0
0,9 to
1,0
0
Figure 6 displays the scatterplot of P (difficulty) by Rpbis (discrimination) for the dichotomously scored
items (correct/incorrect).
Figure 6: P by Rpbis
Figure 7 displays the scatterplot of the Item Means (difficulty) by R (discrimination) for polytomously
scored items (rating scale or partial credit).
Figure 7: Item Means by R
Item-by-item results
The following section presents the item-by-item results of the analysis. Each item has several tables and
a figure. The figure, called a quantile plot, shows the proportion of examinees selecting each option, for
consecutive segments of the examinees as ranked by score. The key thing to evaluate in this figure is
that the line for the correct answer has a positive slope (goes up from left to right), which means that
examinees with higher scores tend to answer correctly more often. Conversely, the lines for the incorrect
options, called distractors, should have a negative slope. Note, however, that the use of a small number
of groups (e.g., 3 or fewer) oversimplifies the graph, so that items which are very difficult or very easy
(that is, discriminating in only the top or bottom 20% of examinees) might appear to have poor quantile
plots and classical statistics. For such items, item response theory presents significant advantages in
analysis
There are four tables presented for each item.
1. Item information table: records the information supplied by the control file (or Iteman 3 header) for this
item.
2. Item statistics table: overall item statistics.
3. Option statistics: detailed statistics for each item, which helps diagnose issues in items with poor
statistics.
4. Quantile plot data: the values used to create the quantile plot.
The item statistics table presents overall item statistics in the first row of numbers. The two most
important item-level statistics for dichotomously scored (correct/incorrect) items are the P value and the
point-biserial correlation, which represent the difficulty and discrimination of the item, respectively. For
polytomously scored (rating scale or partial credit) items, the difficulty is represented by the mean
(average) item score, while the discrimination is represented by a Pearson r correlation.
The P value is the proportion of examinees that answered an item in the keyed direction. P ranges from
0 to 1. A high value (0.95) means that an item is easy, a low value (0.25) means that the item is difficult.
The point-biserial correlation (Rpbis) is a measure of the discriminating, or differentiating, power of the
item. Rpbis ranges from -1 to 1. A negative Rpbis is indicative of a bad item as lower scoring
examinees are more likely than higher scoring examinees to respond in the keyed direction.
For rating scale or partial credit items, the mean item score ranges from the minimum to the maximum of
the scale. For example, if the item has a rating scale of 1 to 5, the possible range for the mean is 1 to 5.
The Pearson r is similar to the Rpbis in that it ranges from -1 to 1, with a positive r indicating that the item
correlates well with total score.
The option statistics table presents statistics for each individual option (alternative). The key thing to
examine in this portion of the table is that no distractors have a higher Rpbis than the correct answer.
That indicates that higher scoring examinees are selecting the incorrect answer, which therefore might be
arguably correct.
The quantile plot data table simply presents the values calculated to create the quantile plot. Because it
contains the same information, the quantile plot itself presents a useful picture of the item's performance,
but this table can be used to examine that performance in detail to help diagnose possible issues.
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
1
1
3
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,51
0,09
0,11
0,76
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
4
0,07
-0,16
-0,31
9,00
4,90
Maro
on
2
22
0,37
0,04
0,06
11,64
3,43
Gree
n
3
30
0,51
0,09
0,11
12,77
4,72
Blue
**KE
Y**
4
2
0,03
-0,06
-0,16
10,00
4,24
Olive
Omit
1
0,02
-0,07
-0,21
8,00
0,00
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
4
0,10
0,18
0,00
0,08
0,00
Maro
on
2
22
0,30
0,36
0,55
0,46
0,23
Gree
n
3
30
0,50
0,45
0,45
0,38
0,77
Blue
**KE
Y**
4
2
0,10
0,00
0,00
0,08
0,00
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
2
2
4
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,51
0,45
0,56
0,73
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
19
0,32
-0,27
-0,35
9,89
2,98
Maro
on
2
3
0,05
-0,22
-0,47
7,67
3,21
Gree
n
3
5
0,08
-0,19
-0,34
9,00
3,39
Blue
4
30
0,51
0,45
0,56
14,13
3,86
Olive
**KE
Y**
Omit
2
0,03
0,00
0,01
11,50
9,19
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
19
0,50
0,55
0,45
0,15
0,08
Maro
on
2
3
0,10
0,18
0,00
0,00
0,00
Gree
n
3
5
0,10
0,18
0,18
0,00
0,00
Blue
4
30
0,30
0,09
0,36
0,85
0,92
Olive
**KE
Y**
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
3
3
4
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,81
0,37
0,54
0,74
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
5
0,08
-0,22
-0,40
8,20
3,83
Maro
on
2
2
0,03
-0,19
-0,46
7,00
4,24
Gree
n
3
4
0,07
-0,19
-0,37
8,25
3,20
Blue
4
48
0,81
0,37
0,54
12,81
4,04
Olive
**KE
Y**
Omit
0
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
5
0,18
0,18
0,00
0,08
0,00
Maro
on
2
2
0,09
0,09
0,00
0,00
0,00
Gree
n
3
4
0,18
0,00
0,18
0,00
0,00
Blue
4
48
0,55
0,73
0,82
0,92
1,00
Olive
**KE
Y**
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
4
4
2
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,49
0,26
0,33
0,74
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
5
0,08
-0,26
-0,47
8,00
3,94
Maro
on
2
29
0,49
0,26
0,33
13,48
3,86
Gree
n
**KE
Y**
3
9
0,15
-0,21
-0,32
9,44
4,77
Blue
4
14
0,24
0,05
0,07
11,79
3,81
Olive
Omit
2
0,03
-0,01
-0,03
11,00
2,83
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
5
0,27
0,10
0,00
0,08
0,00
Maro
on
2
29
0,18
0,40
0,64
0,58
0,69
Gree
n
**KE
Y**
3
9
0,27
0,20
0,18
0,08
0,08
Blue
4
14
0,27
0,30
0,18
0,25
0,23
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
5
5
3
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,88
0,18
0,30
0,75
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
1
0,02
-0,19
-0,60
5,00
0,00
Maro
on
2
0
0.00
--
--
--
--
Gree
n
3
52
0,88
0,18
0,30
12,31
4,36
Blue
**KE
Y**
4
6
0,10
-0,11
-0,19
9,67
2,50
Olive
Omit
0
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
1
0,09
0,00
0,00
0,00
0,00
Maro
on
2
0
0,00
0,00
0,00
0,00
0,00
Gree
n
3
52
0,73
0,91
0,82
0,92
1,00
Blue
**KE
Y**
4
6
0,18
0,09
0,18
0,08
0,00
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
6
6
3
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,69
0,51
0,67
0,73
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
9
0,15
-0,36
-0,55
7,89
2,42
Maro
on
2
4
0,07
-0,33
-0,63
6,50
2,89
Gree
n
3
41
0,69
0,51
0,67
13,54
3,77
Blue
**KE
Y**
4
4
0,07
-0,15
-0,29
9,00
2,71
Olive
Omit
1
0,02
0,07
0,23
15,00
0,00
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
9
0,45
0,27
0,09
0,00
0,00
Maro
on
2
4
0,27
0,09
0,00
0,00
0,00
Gree
n
3
41
0,18
0,45
0,82
1,00
1,00
Blue
**KE
Y**
4
4
0,09
0,18
0,09
0,00
0,00
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
7
7
4
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,42
0,46
0,58
0,73
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
21
0,36
-0,28
-0,36
10,00
3,30
Maro
on
2
4
0,07
-0,03
-0,07
11,00
2,16
Gree
n
3
9
0,15
-0,23
-0,36
9,33
2,06
Blue
4
25
0,42
0,46
0,58
14,60
4,44
Olive
**KE
Y**
Omit
0
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
21
0,55
0,45
0,45
0,31
0,08
Maro
on
2
4
0,00
0,18
0,09
0,08
0,00
Gree
n
3
9
0,18
0,36
0,27
0,00
0,00
Blue
4
25
0,27
0,00
0,18
0,62
0,92
Olive
**KE
Y**
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
8
8
2
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,24
0,30
0,42
0,74
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
23
0,39
-0,28
-0,36
10,26
3,99
Maro
on
2
14
0,24
0,30
0,42
14,86
4,85
Gree
n
**KE
Y**
3
20
0,34
-0,06
-0,08
11,35
2,96
Blue
4
1
0,02
0,17
0,54
17,00
0,00
Olive
Omit
1
0,02
0,07
0,20
15,00
0,00
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
23
0,64
0,45
0,27
0,50
0,15
Maro
on
2
14
0,09
0,18
0,09
0,17
0,62
Gree
n
**KE
Y**
3
20
0,27
0,36
0,64
0,33
0,15
Blue
4
1
0,00
0,00
0,00
0,00
0,08
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
9
9
2
Yes
4
1
K, LR
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,19
-0,15
-0,21
0,77
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
13
0,22
-0,22
-0,31
10,00
4,04
Maro
on
2
11
0,19
-0,15
-0,21
11,45
4,24
Gree
n
**KE
Y**
3
24
0,41
0,14
0,18
12,46
3,65
Blue
4
9
0,15
0,32
0,49
14,89
4,48
Olive
Omit
2
0,03
-0,12
-0,28
7,00
4,24
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
13
0,30
0,60
0,00
0,15
0,15
Maro
on
2
11
0,30
0,10
0,27
0,15
0,15
Gree
n
**KE
Y**
3
24
0,30
0,30
0,64
0,46
0,38
Blue
4
9
0,10
0,00
0,09
0,23
0,31
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
10
10
1
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,69
0,32
0,42
0,74
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
41
0,69
0,32
0,42
13,07
4,05
Maro
on
**KE
Y**
2
9
0,15
-0,20
-0,31
9,33
4,15
Gree
n
3
3
0,05
0,06
0,14
12,33
2,08
Blue
4
5
0,08
-0,22
-0,39
8,40
2,88
Olive
Omit
1
0,02
-0,10
-0,32
4,00
0,00
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
41
0,40
0,55
0,82
0,77
0,92
Maro
on
**KE
Y**
2
9
0,40
0,18
0,09
0,08
0,08
Gree
n
3
3
0,00
0,09
0,00
0,15
0,00
Blue
4
5
0,20
0,18
0,09
0,00
0,00
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
11
11
2
Yes
4
1
K
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,27
0,12
0,16
0,75
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
31
0,53
0,19
0,24
12,39
3,80
Maro
on
2
16
0,27
0,12
0,16
13,44
4,07
Gree
n
**KE
Y**
3
4
0,07
-0,44
-0,84
5,00
1,41
Blue
4
7
0,12
-0,02
-0,03
11,43
3,26
Olive
Omit
1
0,02
-0,11
-0,32
4,00
0,00
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
31
0,50
0,36
0,64
0,62
0,54
Maro
on
2
16
0,00
0,45
0,27
0,23
0,38
Gree
n
**KE
Y**
3
4
0,40
0,00
0,00
0,00
0,00
Blue
4
7
0,10
0,18
0,09
0,15
0,08
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
12
12
4
Yes
4
1
K
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,14
0,06
0,09
0,75
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
12
0,20
-0,04
-0,06
11,42
5,11
Maro
on
2
7
0,12
-0,06
-0,09
11,14
4,56
Gree
n
3
30
0,51
0,13
0,16
12,30
3,46
Blue
4
8
0,14
0,06
0,09
13,38
5,04
Olive
**KE
Y**
Omit
2
0,03
-0,13
-0,32
6,00
2,83
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
12
0,44
0,09
0,18
0,15
0,23
Maro
on
2
7
0,22
0,18
0,00
0,15
0,08
Gree
n
3
30
0,33
0,45
0,64
0,69
0,46
Blue
4
8
0,00
0,27
0,18
0,00
0,23
Olive
**KE
Y**
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
13
13
3
Yes
4
1
K
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,17
0,02
0,03
0,76
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
15
0,25
0,06
0,09
12,20
4,99
Maro
on
2
22
0,37
0,16
0,20
12,59
4,07
Gree
n
3
10
0,17
0,02
0,03
12,90
3,51
Blue
**KE
Y**
4
11
0,19
-0,20
-0,29
10,00
3,38
Olive
Omit
1
0,02
-0,11
-0,32
4,00
0,00
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
15
0,30
0,18
0,18
0,38
0,23
Maro
on
2
22
0,30
0,36
0,45
0,31
0,46
Gree
n
3
10
0,00
0,27
0,18
0,15
0,23
Blue
**KE
Y**
4
11
0,40
0,18
0,18
0,15
0,08
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
14
14
4
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,66
0,38
0,49
0,74
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
3
0,05
-0,13
-0,28
9,00
4,00
Maro
on
2
8
0,14
-0,26
-0,41
8,63
3,25
Gree
n
3
8
0,14
-0,09
-0,14
10,38
3,29
Blue
4
39
0,66
0,38
0,49
13,33
4,04
Olive
**KE
Y**
Omit
1
0,02
-0,10
-0,32
4,00
0,00
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
3
0,10
0,09
0,00
0,08
0,00
Maro
on
2
8
0,40
0,09
0,18
0,08
0,00
Gree
n
3
8
0,20
0,18
0,27
0,00
0,08
Blue
4
39
0,30
0,64
0,55
0,85
0,92
Olive
**KE
Y**
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
15
15
1
Yes
4
1
K, LR
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,31
-0,04
-0,05
0,76
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
18
0,31
-0,04
-0,05
12,39
4,27
Maro
on
**KE
Y**
2
7
0,12
-0,22
-0,36
9,14
3,24
Gree
n
3
4
0,07
0,14
0,27
13,75
3,20
Blue
4
27
0,46
0,25
0,31
12,74
3,99
Olive
Omit
3
0,05
-0,17
-0,35
5,67
3,79
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
18
0,22
0,50
0,18
0,38
0,31
Maro
on
**KE
Y**
2
7
0,33
0,10
0,18
0,08
0,00
Gree
n
3
4
0,00
0,10
0,00
0,15
0,08
Blue
4
27
0,44
0,30
0,64
0,38
0,62
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
16
16
1
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,54
0,32
0,40
0,74
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
32
0,54
0,32
0,40
13,53
4,19
Maro
on
**KE
Y**
2
3
0,05
-0,02
-0,05
11,00
0,00
Gree
n
3
10
0,17
-0,03
-0,05
11,10
3,41
Blue
4
12
0,20
-0,28
-0,40
9,17
3,95
Olive
Omit
2
0,03
-0,10
-0,23
8,00
5,66
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
32
0,40
0,45
0,30
0,62
0,92
Maro
on
**KE
Y**
2
3
0,00
0,00
0,30
0,00
0,00
Gree
n
3
10
0,20
0,18
0,10
0,38
0,00
Blue
4
12
0,40
0,36
0,30
0,00
0,08
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
17
17
4
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,29
0,37
0,49
0,74
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
23
0,39
-0,21
-0,26
10,61
3,38
Maro
on
2
6
0,10
-0,12
-0,21
10,17
2,32
Gree
n
3
11
0,19
-0,04
-0,06
11,27
5,18
Blue
4
17
0,29
0,37
0,49
14,94
3,61
Olive
**KE
Y**
Omit
2
0,03
-0,05
-0,13
10,00
8,49
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
23
0,50
0,45
0,64
0,31
0,17
Maro
on
2
6
0,10
0,27
0,09
0,08
0,00
Gree
n
3
11
0,40
0,09
0,09
0,15
0,25
Blue
4
17
0,00
0,18
0,18
0,46
0,58
Olive
**KE
Y**
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
18
18
4
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,85
0,48
0,74
0,73
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
2
0,03
-0,17
-0,40
7,50
2,12
Maro
on
2
4
0,07
-0,28
-0,53
7,00
3,16
Gree
n
3
3
0,05
-0,33
-0,70
5,33
2,52
Blue
4
50
0,85
0,48
0,74
12,88
3,85
Olive
**KE
Y**
Omit
0
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
2
0,09
0,09
0,00
0,00
0,00
Maro
on
2
4
0,27
0,00
0,09
0,00
0,00
Gree
n
3
3
0,27
0,00
0,00
0,00
0,00
Blue
4
50
0,36
0,91
0,91
1,00
1,00
Olive
**KE
Y**
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
19
19
3
Yes
4
1
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,80
0,45
0,64
0,73
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
2
0,03
-0,24
-0,58
6,00
0,00
Maro
on
2
5
0,08
-0,32
-0,57
7,00
2,74
Gree
n
3
47
0,80
0,45
0,64
13,02
3,91
Blue
**KE
Y**
4
5
0,08
-0,18
-0,32
8,80
3,63
Olive
Omit
0
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
2
0,18
0,00
0,00
0,00
0,00
Maro
on
2
5
0,27
0,18
0,00
0,00
0,00
Gree
n
3
47
0,36
0,73
0,91
0,92
1,00
Blue
**KE
Y**
4
5
0,18
0,09
0,09
0,08
0,00
Olive
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
20
20
4
Yes
4
1
K
Item statistics
N
P
Total
Rpbis
Total
Rbis
Alpha
w/o
59
0,24
0,06
0,09
0,76
Option statistics
Option
N
Prop
.
Rpbi
s
Rbis
Mean
SD
Color
1
7
0,12
-0,19
-0,31
9,57
4,31
Maro
on
2
8
0,14
-0,09
-0,14
10,75
5,55
Gree
n
3
27
0,46
0,11
0,14
12,19
3,87
Blue
4
14
0,24
0,06
0,09
13,14
4,38
Olive
**KE
Y**
Omit
3
0,05
0,03
0,05
12,33
2,08
Not
Admin
0
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
1
7
0,18
0,20
0,18
0,00
0,08
Maro
on
2
8
0,27
0,20
0,09
0,00
0,15
Gree
n
3
27
0,36
0,40
0,55
0,55
0,54
Blue
4
14
0,18
0,20
0,18
0,45
0,23
Olive
**KE
Y**
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
21
21
1
Yes
2
1
Item statistics
N
Mea
n
Total
R
Total
Rbis
Alpha
w/o
59
0,44
0,31
0,38
0,74
Option statistics
Option
Weigh
t
Prop.
Rpbi
s
Rbis
Mean
SD
Color
0
0
0,54
-0,32
-0,40
10,28
3,84
Maro
on
1
1
0,44
0,30
0,38
13,77
4,06
Gree
n
Omit
0,02
0,08
0,26
16,00
0,00
Not
Admin
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
0
32
0,91
0,64
0,45
0,62
0,17
Maro
on
1
26
0,09
0,36
0,55
0,38
0,83
Gree
n
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
22
22
1
Yes
2
1
Item statistics
N
Mea
n
Total
R
Total
Rbis
Alpha
w/o
59
0,69
0,24
0,29
0,74
Option statistics
Option
Weigh
t
Prop.
Rpbi
s
Rbis
Mean
SD
Color
0
0
0,29
-0,24
-0,32
9,65
4,31
Maro
on
1
1
0,69
0,22
0,29
12,76
4,01
Gree
n
Omit
0,02
0,09
0,26
16,00
0,00
Not
Admin
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
0
17
0,55
0,36
0,27
0,15
0,17
Maro
on
1
41
0,45
0,64
0,73
0,85
0,83
Gree
n
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
23
23
1
Yes
2
1
Item statistics
N
Mea
n
Total
R
Total
Rbis
Alpha
w/o
59
0,36
0,44
0,56
0,73
Option statistics
Option
Weigh
t
Prop.
Rpbi
s
Rbis
Mean
SD
Color
0
0
0,64
-0,44
-0,56
10,29
3,96
Maro
on
1
1
0,36
0,44
0,56
14,86
3,11
Gree
n
Omit
Not
Admin
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
0
38
0,91
1,00
0,73
0,46
0,23
Maro
on
1
21
0,09
0,00
0,27
0,54
0,77
Gree
n
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
24
24
1
Yes
2
1
Item statistics
N
Mea
n
Total
R
Total
Rbis
Alpha
w/o
59
0,29
0,42
0,56
0,73
Option statistics
Option
Weigh
t
Prop.
Rpbi
s
Rbis
Mean
SD
Color
0
0
0,71
-0,42
-0,56
10,57
3,74
Maro
on
1
1
0,29
0,42
0,56
15,24
3,67
Gree
n
Omit
Not
Admin
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
0
42
1,00
0,82
0,82
0,69
0,31
Maro
on
1
17
0,00
0,18
0,18
0,31
0,69
Gree
n
Item information
Se
q.
ID
Key
Scor
ed
Num
Options
Doma
in
Flags
25
25
1
Yes
2
1
Item statistics
N
Mea
n
Total
R
Total
Rbis
Alpha
w/o
59
0,44
0,63
0,79
0,72
Option statistics
Option
Weigh
t
Prop.
Rpbi
s
Rbis
Mean
SD
Color
0
0
0,56
-0,63
-0,79
9,33
3,16
Maro
on
1
1
0,44
0,63
0,79
15,19
3,11
Gree
n
Omit
Not
Admin
Quantile plot data
Option
N
0-20
%
20-40
%
40-60
%
60-80
%
80-10
0%
Color
0
33
1,00
0,91
0,64
0,31
0,08
Maro
on
1
26
0,00
0,09
0,36
0,69
0,92
Gree
n